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This study was conducted at Iowa State University 
to test the hypothesis that undergraduate engineering 
and science students deteid.orate In writing skills 
between the time they complete Fi.*eshman English and the 
time they graduate. Five groups comprising 361 subjects 
(72 freshmen, 70 sophomores, 71 Juniors, 74 seniors, and 
74 technical writing students) were given 140 minutes of 
tests. Each subject took two free-response essay tests 
and one objective test. The means of the composite 
scores for these tests show ^no .significant difference 
between the writing abilities of freshmen, sophomores, 
Jtmiors, seniors, and technical writing students. A 
regression analysis was perfoiwied to discover the 
inter-relationship of all variables, including earlier 
test scores, the average of FresMon English grades, 
high school rank, curriculum, grade point average, and 
the sequence in which the tests were taken. The cor- 
relation between the composite scores and MSA.T and ACT 
total scores was higher than the correlation between 
the composite scores and the average of Freshman English 
grades or the English Placement score. It was inferred 
that engineering and science students do not deteriorate 
In writing ability between the time they complete 
Freshman English and the tifte they graduate. In the 
opinion of the principal Investigator, graduate engineers 
and scientists need very specific writing skills, which 
might be inculcated in a senior course devoted to teach- 
ing technical writing format and the translation of 
quantitative thinking and scientific procedures Into 
coherent prose. 
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INTRODUCTIOK 



The Background of the Problem 



Pbr many years there has been a suspicion among 
teachers of college English that undergraduate engineer* 
ing and science students, without instruction in exposi- 
tory writing beyond the freshman year, deteriorate in the 
ability to comtiunicate in writing* This suspicion is 
based in part on the knowledge that the awerage engineer- 
ing or physical science student may, from his earliest 
school years, hawe preferred the study of science or 
mathematics to the study of literature and composition 
and that many college curricula abet such a student in 
further narrowing his interests by requiring no more 
than nine quarter-hours or six semester-hours of instruc- 
tion in writing and tho study of literature* 

This impression has also been fostered by employers 
who imply that their graduate engineers and scientists 
often do not command the communication skills requisite 
to the successful performance of their duties* Further 
support has been given to the hypothesis by a report on 
a survey cc» ducted by the Joint ECAC Feedback Committee 
of the American Society for Engineering Education* . The 
survey,, based on responses to a questionnaire asking 
graduate engineers to list their hi^^est subject training 
needs (seen in retrospect), indicated that most respond- 
ents placed Technical Writing second only to Management 
Practices*^ The inference made by many English teachers 
(including the principal investigator on this project) 
was that, if graduate engineers view training in techni- 
cal writing as a real need, they probably deem mere 
Ft*eshman English as inadequate training for the writing 
tasks confronting them in the post-graduate world* 

In this study, the investigator proceeded on the 
assumption that most engineering students are, despite 
their keen interest in science and technology, as natural 
ly well-endowed with the ability to write coherent and 
forceful English prose as are students majoring in the 



^ Education in Industry t A Study by the Joint 
Engineering College Administrative Council and the Rela- 
tions with Industry Division Feedback Committee 
(Washington, D*C*, 1965)* 




humanities* The assumption was partially generated by an 
awareness of a study conducted in 1953 by Professor R. P* 
Weeks of the University of Michigan* Professor Weeks 
reported that no significant differences were detected 
between the vocabulary skills » reading speed, and compre- 
hension of a group of one hundred Michigan englneexdng 
freshmen and a group of one hundred students of the College 
of .Literature, Art, and Science*^ 

The contradiction between this evidence of fair writ- 
ing ability in engineering freshmen and the general impres- 
sion among employers, English teachers, and graduate engi- 
neers that people in scientific and technological disci- 
plines have serious writing problems suggested that some 
circumstance— pex^ps an almost exclusive preoccupation 
with mathematical rather than verbal symbols— diminished 
language skills between the time a student completed Pt>esh- 
man English and the time he graduated from college* 



A Statement of the Problem 



Accordingly, it was hypothesised that students major- 
ing in engineering and science need instruction in exposi- 
tory coxnpositlon at a level beyond that of the freshman 
year and the completion of the traditional courses in 
Freshman English— and that expository skills deteriorate 
between the freshman and senior years in a science-oriented 
curriculum where the pz^evailing preoccupation is with 
mathematical, rather than with verbal, symbols* It was 
hop^d that a series of writing tests, if administered to 
five groups of students— one group Qf freshmen, one group 
of sophomores, one group of Juniors, one group of seniors, 
and one group of Juniors and seniors who had completed a 
course in technical writing— might confirm or deny the 
hypothesis by making possible a comparison of individual 
with individual and class with class* If the hypothesis 
were proven true, the implication would be that engineer- 
ing and science students sorely needed at least one 
composition course beyond the freshman complex, probably 
in the Junior or senior year* If the hypothesis were 
proven false, then the implication would be that some 
factor other than deterioration is responsible for the 



^ Edward Foster, **College English for Non-Major 
Students , " College English ( MAy , 1969 ) , 389 * 
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general Impression that scientists and engineers cannot 
write well in line of duty* 

Kot the least of the difficulties involved in an 
attempt to confirm or deny the hypothesis was the choice 
of suitable instruments fortesting* The validity of 
writing tests has long been a bone of contention among 
educators* Since 1921 the College Entrance Examination 
Board has sought a means of objectifying graders* judg- 
ments of writing samples* In 1945 Noyse^ Sale, and 
Stalnaker reviewed the data from six different one-hour, 
essay examinations and concluded that the reliability of 
the reading had been too low to satisfy College Board 
Standards* In 1955 Pearson evaluated an experiment with 
a two-hour General Composition Test but repoited that it 
was no more reliable than the shorter essay examinations 
used in earlier years* Eventually it became patent that 
the unreliability of essay tests stemmed fromt 1} the 
difference in quality of ’"Student writing from one topic 
to another; 2) the different opinions among readers 
about the characteristics of good writing;* and 3) the 
distortion in values produced by analytical, rather than 
holistic, reading* The problem of assessing a paper was 
further complicated by the difficulty of finding a 
logically sound criterion of composition skills* 

Thus the principal investigator for this project 
was faced with the necessity for finding tests of writing 
ability that would not be unjustly discriminatory because 
of the assigned topic*s special appeal to the verbally 
gifted or widely read student; that could be graded 
according to criteria established for, but not to* the 
readers; that could be rated according to a holistic, 
rather than an analytical, reading* At the same time, 
some means had to be employed for discovering how students 
varied in particular writing skills (such as organisation, 
the appropriate use of ccxiventions, and critical thinking) 
according to their year in college, their curricula, their 
previous training, and their native abilities* It. was 
felt that at least two essay tests (to be graded holisti- 
cally) and at least one objective test (to yield sub- ^ 
scores on specific skills) were required* 
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The Tests . 



All of the subjects ultimately Included In this study 
took 140 minutes of tests—the Sequential Test of Educa- 
tional Progress (STEP) Essay Test (FDrm8 lA and 1C) and the 
Sequential Test of Educational Progress (STEP) Writing 
Test (Form lA). 



The Sequential Test of Educational Progress (STEP) Essay 
*i?e3t (rorms lA and Ic) 



The STEP Essay Test» published by the Educational 
Testing Service^ is a free-response test of writing ability. 
The principal Investigator deemed It appropriate to this 
study because, according to the Educational Testing 
Service,^ it Is designed to be rated holistically, rather 
than analytically; because the free responses rated accord- 
ing to models will theoretically resip.t In a significant 
degree of reliability among readers;^ and because the 
writing topics appeared to have a universality of appeal. 
Thirty-five minutes were allowed for the writing of each 
essay. 

Level 1 of the test was chosen because of Its appro- 
priateness to college freshmen and sophomores. Two differ- 
ent forms were used— STEP Essay, Pbrm lA, and STEP Essay, 
Pbrm 1C. Every subject on whom data was eventually compil- 
ed was required to write both STEP Essay, Form lA, and 
STEP Essay, Form 1C. Each version of the test presents a 
brief paragraph setting forth a topic to write about. 

(See Appendix A.) 

The Sequential Test of Educational Progress (STEP) Writing 
Test (Form lA) 

Despite Its name, the STEP Writing Test is an objec- 
tive test, made up of 60 multiple choice questions, SO 
questions to each of two parts. It is, according to the 



^ STEP Handbook for Essay Tests, I^yel 1 (Los Angeles. 
1967) 5. 
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Educational Testing Service,^ designed to test specific 
writing skills— namely! 

!• Organisation (the ordering of ideas). 

S. The use of conventions (syntax, sentence struc- 
ture, diction, punctuation, and spelling). 

3. Critical Thinking (detection of unstated 
assumptions, logical relationships, and antici- 
pation of the reader's needs). 

4. Effective presentation (adequacy of eni^sis 
and development; precision and conciseness of 
expression). 

5. The appropriate choice of a level of usage. 



This test seemed a particularly appropriate device 
to incorporate in a program using the STEP Essay Testr, 
not only because it was conceived to yield sub-scores 
on specific skills whereas the Essay Tests are designed 
for holistic reading, but also because (according to 
the Educational Testing Service) the correlations be- 
tween Essay scores and Writing Test scores are essen- 
tially indistinguishable from the correlations between* 
essay scores.^ (She Appendix B.) Most of the items 
on the STEP Writing Test are revision items. Thirty- 
five minutes were allowed for the completion of each 
of the two parts. 



The Method of Administering the Tests 

Every subject was required to attend two testing 
sessions. At the first testing session the STEP Essay 
Test, Fbm lA, and the first part of the STEP Writing 
Test were given. At the second testing session, scted- 
uled no less than twenty-four hours after the first 
session, STEP Essay Test, Form 1C, and the second part 
of the STEP Writing Test were administered. At each 
session the order in which the essay test and one part 



^ STEP Teacher's Guide ; Heading , Writing . Listen- 
ing . Social Studies . "Science ( Los Angeles , ldS9)7 4d^47 . 

2 '■ 

STEP Handbook for Essay Tests. Level 1 (Los 
Angeles, 19^). il. 
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of the ohJectlTe test was given was varied, with ecne etv 
dents taking the Essay Test first and then the appropriate 
part of the Writing Test* Other subjects took the appro- 
priate part of the Writing Test first and the Essay Test 
second* 



The Subjects 



Between April 25 and October 25, 1968, the two STEP 
Essay Tests and one STEP Writing Test were administered to 
561 Iowa State University students majoring in science or 
engineering* Twenty-five different curricula are repre- 
sented, most of which are presumed to be primarily con- 
cextied with quantitative, rather than verbal, symbols* 

(See Appendix C*) Subjects were volunteers, some paid, 
some recruited by teleidione calls, letters, advertising, 
and appeals to classes* 

There were 72 freshmen, 70 sophomores, 71 juniors, 

74 seniors , and 74 students who had completed or were 
about to complete English 414 (the Writing of Beports and 
Technical Papers)* All freshmen had to be in the latter 
third of their last quarter of Fresfamar glish at the 
time they took the tests and, in order Uw be included In 
the data, had to pass that quarter* (The A?eshman Eziglish 
complex at Iowa State totals nine quarter hours*) All 
soidiomores, juniors, seniors, and 414 students had to have 
completed Fishman English with a passing grade but were 
not eligible to take the tests if they had taken eoiqposi- 
tion courses beyond the freshman complex* The stipulation 
that subjects should not have taken additional English 
courses did not apply to fl»e8hmen inasmuch as they are 
not allowed to take anything but Freshman English* 

Although tests were administered to 424 students, 

65 of these tests had to be discarded because t 41 sub- 
jects did not return to take the second set of tests ^ 

11 subjects had no records of ACT, MSAT, and English 
Placement scores and no record of high school rank; 
seven subjects had shifted majors between the time they 
were contacted and the time they took the tests; two 
subjects were obviously foreign-speaking; and two sub- 
jects had to leave the testing situation before complet- 
ing their papers* After six months of canvassing engineer- 
ing and science students for possible subjects, the 
principal investigator felt further efforts to recruit 
would be profitless* 
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Kinda of Data Collected mi Subjects 



Twenty-two pieces of data were collected on each 
subject. Part of the data were baclcground facts; the 
rest were scores on the STEP Essay Tests and the STEP 
Writing Tests, and the sequence in which these tests 
were taken* 



Background Data 

Among those facts relevant to the subjects* back- 
ground,^ part or all of tlie following informat ion. was 
gathered: 

1* The subject *s. major curriculum 

2* The average of the subject's grades in Presh-i' 
man English at Iowa State University 

3* The subject's ACT (American College Testing 
Program) total 

4* The subject's ISSAT (Minnesota Scholastic 
Aptitude Test) total 

5* The subject's score on the English Placement 
Test (Cooperative English Test) 

6* The subject's high school rank 

7* The subject's cumulative grade point average 
at the beginning of the quarter during which 
he took the test 

8* The subject's grade in Engli^ 414 (if any) 



^ In the original proposal it was suggested that 
involvement in Iowa State University's on-the-Job 
training program would be considered as a variable, 
but since less than two per cent of the subjects were 
so Involved, this factor was finally ignored. Also 
abandoned was -the plan to take into account scores 
on the Senior English Examination* As of June, 1968, 
the proficiency exam is no longer required of those 
Iowa State seniors who have earned at least a "C" in 
each quarter of Freshman English* Thus, only an 
insignificant number of the subjects would have taken 
the Senior English Examination* 
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Scores on the STEP Essay Tests and the STEP Writing Test - 

The following Infornstlon was collected about the 
subjects* perfomance on tests used in this study t 

1* Scores on the STEP Essay jbests 

a* Form 14 (three grades » one for each reader) 
b* Form 1C (three grades, one for each reader) 
c* The total of the three scores for Form lA 
d* The total of the three scores for Form 1C 
e* The total of the totals for Forms lA and 1C 

2* Scores on the STEP Writing Test 
a* Form lA, Part 1 
b* Form lA, Part 2 • 

c« The total of the scdres on Fart .1 and Part 2 

3* The total of the totals, or the composite score, 
for the STEP Bssay Test and the STEP Writing Test 

4* The sequence in which the two Essay Tests and the 
two parts of the Writing Test were taken. 



In 329 cases a record was kept of the sequence in which 
the subject took the two Essay Tests and the two parts of 
the Writing Test. The object of this record was to deter- 
mine the fatigue effect of the two types of test— free- 
response and objectiwe. There were four possible sequences} 

1-1 STEP Writing Test, Part 1, first 
(at first testing session) 

STEP Writing Test, Part 2, first 
(at second testing session) 

1-2 STEP Writing Test, Part 1, first 
(at first testing session) 

STEP Writing Test, Part 2, second 
(at second testing session) 
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2-1 STEP Writing Test, Part X, second 
(at first testing session) 

STEP Writing Test, Part 2, first 
(at second testing session) 

2-2 STEP Writing Test, Part 1, second 
(at first testing session) 

STEP Writing Test, Part 2, second 
(at second testing session) 



Grading Procedures 



Every subject was given a code number, which was 
written in the upper ri£^t-hand comer of the STEP Essay 
booklets and entered in the identification box on the 
IBM 1250 answer sheet for the STEP Writing Test* The 
STEP Writing Test was scored by computer* 

The Essay Tests were typewritten in quadruplicate 
so that one copy, along with the original essay booklet, 
could be kept in the principal investigator's files and 
one copy could be distributed to each reader* 

Each essay was read by three readers— Mrs* Phyllis 
Glass, B*S«; Mr* Aubrey Galyon, M*A*^and Mr* Honald 
Williams, M*A* Every reader had had at least three 
years of experience in teaching Freshman English at a 
state university and was, at the tine of the reading, 
employed as an instructor in English in the Department 
of Englidi and Speech at Iowa State University* 

The essays were graded by the comparison method and 

g iven a rating any place from (and Including) "1" through 
7," with *7** at the hl^ end of the scale* The STEP 
Handbook for Essay Teats > Level 1 contains models of 
essays on tiie topics assigned in*~Essays lA and 1C, and 
the graders were instructed to Ignore their own criteria 
and to match each paper with one of the thme models 
jprovlded (for the ratings ••4,'* and "S") or to place 

it someplace within range of the models* 

Although, according to the Handbook * the readers 
for the model essays scored papers on the basis of 
quality of thought (50 per cent), style (50 per cent). 
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and conventions (20 per cent)» they gave no mark other than 
a number to a paper and thus avoided giving a score that 
could be precisely analysed.^ The readers employed In the 
project that Is the subject of this report were asked to 
make no marks on the papers and to refrain from discussing 
essays with other readers* 

In order to avoid interference with regular teaching 
duties, the essays were distributed in three equal batches 
over a two-month period. Hatlngs were entered, alongside 
the appropriate code number, on a score sheet. VVhen all 
the papers had been read, all three of a subject *s scores 
for Essay lA were added, all three of his scores for Essay 
1C were added, and the total of these two scores was added 
to the total score for the STEP Writing Test. 



STEP Handbook ibr Essay Tests * Level 1 (Los Angeles, 
1957), 6. 
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ANALYSIS AI^D FINDINGS 



Method of Analysis 



The data collected were subjected to a complete 
regression analysis In order to 1) compensate for the 
lack of randomness In the selection of subjects, 2) to 
yield Information about the relative writing skills of 
the five categories, and 5) to discover the Inter- 
relationship of such variables as test scores and the 
sequence in which the tests were taken, test scores and 
the subject’s curriculum, test scores and Freshman 
English grades, earlier test scores, high school rank, 
and grade point average* Also through the. regression 
analysis, the mean score on the Essay Tests was cor- 
related with the mean score on Writing Tests, and the 
reliability among readers was established* For statis- 
tical purposes, curricula were categorized in six large 
groups* (See Appendix C*) 

The plan to break down the Writing Test scores into 
subscores was abandoned because the reliability estimate 
was only *72 as computed by KR-20* Since reliability, 
or measurement accuracy, depends on inter-item correla- 
tion and the number of items. It was Inferred that any 
analysis of subscores would be meaningless because of 
the small number of Items in each subscore* 

Although the original research design (as detailed 
In the proposal) implied that the five groups’ perform- 
ances on the essay test would be evaluated through the 
Chi Square test of independence. Dr* John W* Menne, 
the statistician for this project, felt that the regres- 
sion analysis was a method tdilch would give much more 
precise measurements than the Chi Square test of Inde- 
pe^ence^^particularly with as large a sample as 361 
subjects* 



Findings 



There appear to be no, or only minimally, significant 
differences In the means of the scores of the five cate- 
gories (Table 1)* Although the Freshman means are cither 
the lowest or among the lowest of those of the various 
categories,, the/ fivd -point difference between these means 
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and those of the Sophomores and 414 Students is probably 
not highly significant. Similarly, although the Sophomore 
means are slightly higher than those of any other group, 
the differences are too slight to be significant. The 
means of the 414 Students are next highest, but, again, not 
enough higher to warrant speculation on the cause. 

In the regression analysis it was found that the effect 
of sequence accounts for more of the variance than do either 
the effect of curriculum or the effect of category (Table 2). 
Even so, the greater significance of the sequence effect's 
variance is probably more a function of the large size of 
the sample than of a meaningful difference. 

The means of the significance of the four possible 
sequences were: 



Sequence 


Number 


1 


(1-1) 


7. OS 


It 


It 


2 


(1-2) 


9.51 


ft 


tt 


5 


(2-1) 


10.77 


It 


It 


4 


(2-2) 


6.2S 



<f- 

Thus the^hird sequence might indicate that taking the 
objective tesc second at the first testing session and 
first at the second session constitutes a more favorable 
set of circumstances than any of the other sequences. 

There is a significant difference between the means 
of composite scores of those student who took both parts 
of the Writing Teat second and those who took it first 
one or both times, but those students who took both 
parts of the objective test first had only the third 
highest mean of the possible foior. 
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Key to Table 2 






1 Class 

2 Curriculum 

3 Average of Freshman English Grade 

4 414 Grade 

5 ACT Total 

6 MSAT Total 

7 English Placement Score 

8 High School Rank 

9 Cumulative Grade Point Average 

23 Composite Score 

24 Year (Category) 

26 Year (Category) 

26 Year (Category) 

27 Year (Category) 

28 Curriculum 

29 Curriculum 

30 Curriculum 

31 Curricultun 

32 Curriculum 

33 Sequence ^ , 

34 Sequence n 

35 Sequence 



Note; In the first line, the criterion is the compos- 
ite score;8^ (23) , the co-variate is the Freshman English 
grade (3), and the treatment is the year (24--27) . 
Co-variate 3 accounts for 17.58^ of the variance which, 
with an F-ratio of 76.16 is highly significant statis- 
tically, though 17 .68^ is an expected percentage for 
this co-variate. Removing the effect of the co-variate 
leaves the treatment accounting for 2. 57% p e r e e nt of 
the criterion variance. This is statistically signifi- 
cant because oJ^^he relatively large number of subjects 
in the study (OrS- level) but 2.57^ is such a small 
percentage of the variance that it is considered 
meaningless. 
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Of the means of those tests taken by the subjects be- 
fore, or upon, entering college, those of the ACT an<J5 MSAT 
totals had the highest correlation with the composite 
scores* Neither the scores on the English Placement Test 
(1-Co operative English Test, Single Booklet, Higher, Form 
T, ETS) nor the average of the pfeshman English grades 
correlated highly with the composite scores* Grade Point 
Average correlated most poorly of all the co-varlates 
(Table 3). 



Table 3. The Correlation of Composite Scores with 
Co-Variates 



Co-Variate 


All Subjects 


414 Students 


Freshman English Grade 


*43 


*44 


ACT Total 


*37 


*55 


MSAT Total 


*47 


*49 


English Placement (1)* 


*44 


*43 


English Placement (2)**^ 


*50 


- 


High School Hank 


-*39 


0 

• 

1 


Grade Point Average 


*34 


o 

CO 

• 


414 Grade 


- 


*34 



* Until September, 1966, I<.S*U. Freshmen took the 
Cooperative English Test, Single Booklet, Higher, Form T, 
ETS* In September of 1966, this form was replaced by the 
Cooperative English Test. English Expression, Form 1C, 
ETS* The designation (1) indicates the earlier test* 

The designation (2) Indicates the later test* Inasmuch 
as few 414 students had taken the later English Placement 
Test, the correlation of this variable was not considered 
relevant * 
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. The correlation ‘between the total score on the 
Writing Test and the composite score on the Essay Tests 
was .38— the same as the correlation between the total 
of the Writing Test and the composite score for Essay 1C 
(Table 4). 



Table ,4. Correlation of Means of Essay Tests with 
Means of Writing Tests 



Essay Tests 


Writing / 


Correlation 


Composite lA & 1C 


Total, Part 1 & 2 

V 


CD 

to 

• 


lA 


Total 


.23 


1C 


Total 


.38 


lA 


Part 1 


.21 


1C 


Part 1 


.34 


lA 


Part 2 


.19 


1C 


Part 2 


.29 



The reliability among the three readers of the 
Essay Tes{ts was found to be .74. By extrapolation 
(from three readers to two), the ETS recders of the 
model essays achieved a .6 reliability.^ 



^ STEP Handbook 
(Los Angeles, 1957), 



for Essay Tests, 



Level 1 



DISCUSSION 



This study has dlsproven the hypothesis that under- 
graduate engineering and science students deteriorate in 
writing ability between the time they complete Fres^an 
English and the time they graduate. Although there were 
slight differences among the means of the five categories, 
none of them were large enough to be significant • One 
might conjecture that the rate of attrition among less able . 
engineering and science students tends to maintain the 
original mean of competence. But such a theory fails to 
take into account the able students who first choose 
engineering or science majors but later discover they want 
to major in one of the disciplines under the humanities. 

If the findings of this study are at all representa- 
tive, some more reasonable explanation must be fo\md for 
the general impression that graduate scientists and engi- 
neers do not write well. There is always the possibility, 
of course, that, because of their predispositions, 
students in technological and scientific disciplines 
graduate and heave a sigh of relief at the prospect of 
never again having to worry about a squinting modifier or 
a sentence fragment. But engineers and scientists are 
often at the helm of important national enterprise. 

Surely, such people have a concern for the clarity and 
propriety of their communication. 

A much more credible reason for the impression is 
that the nature of engineers* and scientists* Jobs forces 
them to woik and write under pressure— and to write more 
accurately and frequently than do people in other profes- 
s ions . 



Most engineers have many reports to write. Blirther- 
more, in the plant or laboratory, the development of the 
process or technique is of primary Importance, and the 
description of that process, secondary. Add to the 
exigencies of a crowded schedule the constant threat of 
one’s training and knowledge becoming obsolete, and the 
average engineer or scientist is confronted with the 
necessity for reading assiduously, researching exhaus- 
tively, and reporting perfunctorily. 

His problem is compounded by the fact that, not only 
must he write under pressure, but he must write with an 
intimidating degree of accuracy under pressure. Without 
question, his writing must be more precisely adapted to 
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practical application than the writing of an English 
teacher or soclologist-*the consequences of a specifica- 
tion for a "fastener” rather than a "10-52 -NP threaded 
stud and nut" can he catastrophic to an astronaut depend- 
ent for his life upon the smooth functioning of his 
spaceship. And certainly, there is more immediately at 
stake in a report on a craft’s airworthiness than in an 
evaluation of a proposed new textbook or a survey of 
community attitude toward low-income housing. 

Thus the responses to the Joint ECAC Psedhack 
Committee’s questionnaire may he assumed to mean exactly 
what they say— that graduate engineers wish they had had 
more technical writing as undergraduates. They do not, 
apparently, wish they had had more general composition. 
They have evidently found in their post ••graduate expert* 
ence that they need instruction in a very special kind 
of writing. What they failed to get college, pe^aps, 
was a course that would enable them to write a report 
without spending hours deciding how best to organize 
facts, display data, and adopt the right tone for the 
intended reader. Those who had a course in technical 
writing may have considered it inadequate because it 
was taught as Just another general composition course 
and too little time was spent in training students to 
translate scientific logic— sometimes Instinctual and 
often unverhallzed--into sentences and paragraphs which 
replicate for the reader the actual sequence of the 
investigator or expediter’s ideas. Such a course— 
placed in the senior year and including problems in 
organization, format, and precision of expression- 
might arm the engineer or scientist with enough auto- 
matic responses to make writing under pressure a more 
mechanical and therefore less time-consuming process. 

Other findings derived from the study are no more 
positive but, at the same time, no less generative of 
speculation about the effects of particular variables 
on a subject’s performance on writing tests. 

The regression analysis indicates that the means 
of those tests usually considered to be tests of general 
academic ability correlate more highly with the means of 
the tests used In this study than do the means of tests 
and other criteria for specific language skills. ?br 
all the subjects considered, the mean of the MSAT totals 
correlates with the mean of composite scores at 
.47. R)r the 414 students, the mean of the ACT totals 
correlates with the mean of composite scores at 
.55. 5br all subjects and for 414 students, the means 



of the average of Freshman English grades correlate with 
composite scores at .43 and .44. Ebr all appropriate sub- 
jects, the mean of the scores on the English Placement 
Test used first at I.S.TI. (Cooperative English Test, 

Single Booklet, Higher, Pbrm T, ETS) correlates with the 
mean of composite scores at .44, although the mean of 
the scores on the English Placement Test now used at 
I.S.TJ. (Cooperative English Test, English Expression, 

R>rm 1C, ETS) correlates at .50 with appropriate sub- 
jects* composite scores. One possible conclusion from 
these findings is that tests of general ability may be 
more carefully standardized than tests of specific skills. 

The regression analysis indicates that the mean of 
cumulative grade point averages correlates with the mean 
of the composite scores at only .34. This correlation 
may suggest that engineering and science students have 
neither the motivation nor background for doing as well 
in composition tests as they do in tests on subject 
matter which seems more relevant to their interests and 
goals. (Pbr example, a typical electrical engineering 
student might concern himself more with getting an "A* 
in a mathematics course than in an English course.) 

The analysis further suggests that the effect of a 
particular curriculum upon writing ability is negligible. 

On the other hand, there is a significant difference 
between the means of composite scores of those students 
who took both parts of the Writing -.Test second and those 
who took it first one time or both times. This differ- 
ence might be construed to mean that the fatigue -effect 
of writing an essay is greater than the fatigue -effect 
of taking an objective test — were it not for the fact that 
those students who took both parts of the objective test 
first had only the third highest mean of the possible 
four. The highest mean related to sequence was that of 
the group which took the objective test second at the 
first session and first at the second session. Because 
the directions for taking the objective Writing Test are 
somewhat complicated, the subjects may have derived an 
advantage from taking it first at the second session, 
when the memory of the proper procedure was relatively 
fresh in their minds and they had reference, not only to 
the proctor’s Instructions, but to their own experience. 

The appropriateness of the tests chosen for the study 
might seem to be called into question by the earlier dis- 
cussion of the kinds of writing ability needed by engineers 
and scientists. But the original hypothesis was that cer- 
tain kinds of undergraduates deteriorated in unspecified 
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writing skills — not that they deteriorated in technical 
writing ability. Hence, the tests chosen may be said 
to be appropriate to the situation. 

The Handbook *s claim that the correlations between 
Essay scores and objective Writing scores ”are essentially 
indistinguishable from the correlations between two Essay 
scores**^ was partially validated. A check on the mean 
of composite scores on the Essays and the mean of total 
scores on the objective test reveals a .38 correlation, 
as does a check on the mean of the total. scores on Essay, 
1C, and the mean of the total scores on the Writing Test. 
The correlation between the means of the total scores for 
the two essays was .40. But the correlation between the 
mean of the total scores on Essay, lA, and the mean of 
the total score for the Writing Test was only .23. 

The comparison method of rating the essays proved 
to be a fortunate choice for this project. The relia- 
bility of the three readers (Mrs. Phyllis Glass, Mr. 
Aubrey Galyon, and Mr. Ronald Williams) was .74. Accord- 
ing to the Handbook, the intro-class correlation of the 
readers of the model essays was only .50 for both Essay 
lA and Essay IC.^ But the standardization program for 
Level 1 essays provided for only two readings of each 
paper by 197 and 226 examinees for Essays lA and 1C 
respectively. The higher reader reliability on this 
study may also be due to the fact that teachers of 
Freshman English at Iowa State University annually 
attend a trading seminar, at which common criteria are 
discussed'^ V/hile the I.S.TJ. readers used in this study 
were enjoined to employ the model essays as criteria, 
rather than their own standards, they may have found 
that, as a result of accepting departmental criteria 
in their usual grading practices, it was easier to 
confoiTO to the Handbook's explicit directions. ^ 



^ STEP Handbook for Essay Tests , Level 1 (Los 
Angeles, 1957), 51. 

2 STEP Handbook , 29. 

^ In a study of the grading methods of the Iowa 
State Department of English (March, 1968), Dr. John W. 
Menne, the statistician for this project, found a .84 
reliability among teachers of Freshman English. Dr.- 
Menne made no inference about instructor bias in rating 
various skills but found that the instructors* method 
of deriving course grades from an evaluation of specific 
skills was consistent. 
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Although it was disappointing to find the reliability 
of the STEP Writing Test too low to warrant use of the sub- 
scores for detecting weaknesses and strengths In specific 
skills, the lack of significant differences In the means 
(of the composite scores) of the five categories makes the 
lack of subscores a negligible defect in the study. Had 
there been a significant difference in composite scores, 
however, the lack of subscores might have been a serious 
deterrent to completing the study. 
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APPENDIX C 



Subjects by General Area and Specific Currl culiaa 



General Area 


Specific Curriculum 


Numher of 
Subjects 


Aerl cultural 


Agricultural Engineering 


13 


Civil 


Aerospace Engineering 
Architecture and Archl- 


36 




tectural Engineering 


28 




Building Construction 


5 




Ceramic Engineering 


13 




Civil Engineering 


29 




Mechanical Engineering 


52 


Chemical 


Chemical Engineering 


36 


Electrical 


Electrical Engineering 


41 


Engineering- 


Operational 


Engineering Operations 


23 




Engineering Technology 


1 




Engineering Science 


2 




Industrial Engineering 


19 


Scientific 


Bacteriology 


1 




Botany 


1 




Biochemistry 


1 




Chemistry . 


12 


t 


Computer Science 


1 




Forestry 


4 




Geology 


7 




Mathematics 


17 




Metallurgy 


3 




Physics 


9 




Science 


5 




Zoology 


3 
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